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ABSTRACT 


The  concept  of  convergent  evidence  can  be  used  to 
accept  or  reject  object  regions  proposed  by  slicing. 

A recursive  region  extraction  scheme  similar  to  that 
of  Ohlander  can  then  be  devised  which  rejects  noise  well 
and  does  not  rely  as  strongly  on  the  independence  of 
multiple  features. 
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1. 


Introduction 


Image  segmentation  methods  which  rely  on  clustering  of 
evidence  from  a single  source  generally  suffer  from  an  in- 
ability to  reject  noise  responses.  Often  simple  heuristics, 
based  on  size  or  thinness,  are  used  to  delete  noise  points/ 
regions.  The  difficulty  in  that  approach  is  that  there 

exists  no  interaction  between  the  region  proposal  and  noise 

I 

cleaning  phases. 

The  work  of  Ohlander  [1]  is  an  attempt  to  overcome  the 
inherent  uncertainty  in  dealing  with  a single  sensor.  By 
starting  with  high  quality  color  images,  additional  useful 
images  can  be  generated  through  grayscale  as  well  as  other 
local  transformations.  Histogreims  are  then  computed  for  each 
of  the  images.  At  any  stage  in  the  remainder  of  Ohlander 's 
algorithm,  a slice  range,  selected  from  the  histogram  with 
the  most  reliable  (image)  partitioning,  is  used  to  extract 
candidate  (object)  regions.  Candidates  are  then  filtered  via 
simple  noise  cleaning  techniques.  The  remaining  regions,  now 
classified  as  objects,  are  removed  from  all  images.  Histo- 
grams are  recomputed  and  the  process  is  repeated  until  no 
more  objects  can  be  extracted. 

The  success  of  Ohlander 's  approach  depends  on  the  diff- 
erential homogeneity  of  regions  with  respect  to  the  computed 
features.  The  misclassification  rate  is  controlled  by  con- 
structing a wider  range  of  signal  sources  and  by  choosing  the 
source  with  the  (current)  best  signal-to-noise  ratio.  None- 


Sfrtu 

;t1lN 


□ 


coia 

itii  ' «Y»iL  im  IT  ritiir 


theless,  the  objection  stated  earlier  still  applies,  since 
the  rejection  or  merging  of  regions  is  done  "blindly". 

In  what  follows,  an  approach  is  described  which  applies 
several  sources  of  information  to  the  same  image  region. 
Coincident  responses  serve  to  verify  the  presence  of  an  object 
region.  The  goal  is  to  reduce  the  error  rate  associated  with 
object  acceptance  and  the  computational  cost  involved  in  main- 
taining multiple  images  and  corresponding  histogreims. 


Region  Extraction  Using  Convergent  Evidence 


The  use  of  convergent  evidence  for  slice  range  selec- 
tion is  discussed  in  [2].  Briefly,  slice  ranges  for  an  image 
are  predicted  by  the  existence  of  clusters  in  a 2-dimensional 
histogreun  of  values  obtained  from  thinned  edge  points.  The 
axes  of  the  histogram  correspond  to  edge  value  and  gray  level 
value.  This  approach  can  be  extended  to  choose  a best  (most 
reliable)  slice  range  from  2-D  histograms  derived  from  color 
or  transform  images;  however,  the  present  work  considers  only 
single  images  and  standard  1-dimensional  histograims. 

Region  extraction  using  convergent  evidence  has  been 
described  in  [3]  in  the  context  of  the  Superslice  algorithm. 

A more  extensive  paper  is  in  preparation.  Superslice  relies 
on  the  heuristic  that  object  regions  are  distinct  from  back- 
ground in  that  they  contrast  with  their  surroundings  at  a 
well-defined  border.  Coincidence  of  high  contrast  and  high 
edge  value  at  the  border  exemplifies  the  convergence  of 
evidence  supporting  the  assertion  of  the  object  region.  The 
"definedness"  of  the  border  may  be  evaluated  as  the  percent- 
age of  border  points  which  coincide  with  thinned  edges 
(locally  maximum  edge  responses).  Thus  a match  score  of  50% 
means  that  half  the  border  points  are  accounted  for  as  lying 
on  edges.  In  addition,  although  not  used  here,  one  can  de- 
mand that  the  matched  points  represent  the  shape  of  the  object 
region.  This  last  notion,  called  "conformity",  is  described 
in  [4]. 


In  the  present  application,  the  following  steps, 
associated  with  the  Superslice  algorithm,  are  used: 

1.  Smooth  the  image,  if  necessary,  to  promote  cleaner 
thresholding. 

2.  Extract  a thinned  edge  picture,  e.g,  by  taking 
differences  of  averages  at  each  point  in  each  of 
several  directions  and  by  applying  local  non-maximum 
suppression. 

3.  Determine  a slice  range  and  create  a binary  image 
by  mapping  into  value  1 those  points  whose  gray 
levels  lie  within  the  slice  range;  i co  0 otherwise. 

4.  Label  all  connected  components  of  I's. 

For  each  connected  region: 

a.  Compute  its  size  or  area. 

b.  Compute  the  percentage  of  border  points  which 
coincide  with  thinned  edge  points. 

c.  Compute  the  average  contrast  across  the  border 
of  the  region. 

d)  Classify  the  candidate  region  as  object/non- 
object based  on  size,  edge-match,  and  contrast. 


corresponding  to  well-defined  regions  will  be  returned  to  the 
APM.  The  resulting  histograms  appear  more  natural  (not 
"carved-out" ) for  this  reason.  Secondly,  the  resulting  decom- 
position is  order-dependent,  i.e.,  different  results  may  be 
obtained  if  the  order  of  selection  of  slice  ranges  is  changed. 
If  two  adjacent  regions  in  the  image  contribute  adjacent  peaks 
in  the  histogram,  then  points  in  the  intersection  of  the  over- 
lapping slice  ranges  will  generally  belong  to  the  shared  edge 
region.  Whichever  region  is  sliced  first  will  tend  to 
accrete  more  of  these  points.  Since  these  points  lie  at  or 
near  the  true  edge,  they  tend  to  increase  the  edge  match 
criterion  ior  that  region.  Once  they  are  removed  from  the 
APM,  they  are  not  available  to  the  adjacent  region.  Con- 
sequently, the  edge  match  criterion  of  the  adjacent  region 
may  suffer.  This  is  most  likely  to  occur  for  adjacent  regions 
which  lack  a strong  common  border.  The  2-dimensional  histo- 
gram approach  in  [2]  can  detect  adjacency  along  weak  borders. 
In  practice,  the  edge  match  criterion  is  relaxed  somewhat 
from  demanding  actual  coincidence  to  allowing  proximity  (e.g., 
a region  border  point  adjacent  to  a thinned  edge  point  is 
counted  as  a match) . 


4. 


Experiments 


The  Hypers lice  algorithm  has  been  implemented  as  an  in- 
teractive system  of  programs . Several  examples  illustrate 
its  ability  to  segment  images  based  on  gray  level  alone  (i.e. , 
no  other  features  were  used  to  aid  the  segmentation) . Figure 
1 depicts  a window  of  an  ERTS  frame  of  the  Monterey  area  in 
California.  The  water  area  contrasts  sharply  with  land  mass 
and  very  little  noise  is  extracted  and  subsequently  returned 
to  the  APM.  The  subsequent  slices  extract  light  and  dark 
fields  which  contrast  with  the  undifferentiated  background  re- 
gion. 

The  second  exeunple  is  derived  from  Ohlander's  house 
scene.  The  average  of  the  three  color  bands  provides  the  gray- 
scale. The  resulting  image  has  been  smoothed  by  3x3  median 
filtering.  The  first  slice  range  extracts  the  sky  regions  and 
the  bright  crown  of  a bush.  Next  the  shadow  regions  appear 
along  with  the  bushes.  The  somewhat  darker  grass  is  extracted 
in  the  third  slice  range.  Finally  the  brick  is  extracted. 

The  importance  of  order  in  the  slice  range  sequence  is 
illustrated  in  Figure  3.  If  the  brick  is  extracted  before 
the  grass,  large  portions  of  grass  region  accrue  to  the  brick 
and  are  therefore  not  availeible  for  inclusion  in  the  grass  re- 
gion extracted  subsequently.  In  a multiple  feature  environ- 
ment, one  would  expect  grass  and  brick  to  contrast  strongly  as 
they  do  in  both  the  red  and  blue  bands.  Nonetheless,  the  im- 
portance of  order  must  be  recognized  when  using  overlapping 
slice  ranges. 
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5.  Conclusion 

The  Ohlander  algorithm  attempts  to  overcome  the  un- 
certainties of  image  slicing  by  making  available  mauiy  images 
(and  their  histograms) . This  increases  the  likelihood  that  a 
region  will  appear  homogeneous,  yet  will  contrast  with  its 
surround,  so  that  slicing  is  effective.  The  Superslice  al- 
gorithm considers  each  sliced  region  individually  and  provides 
criteria  for  its  acceptance.  This  allows  slicing  artifacts 
to  be  rejected  and  also  provides  a figure  of  merit  for  well- 
definedness.  The  Hyperslice  algorithm  is  an  attempt  to  com- 
bine these  orthogonal  points  of  view. 
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Figure  1.  Recursive  region  extraction  - Monterey 
image . 

a.  ERTS  window. 

b.  Edge  map. 

c.  Histogram  of  a.,  with  selected  slice 
range  indicated. 

d.  Mask  of  slice  range.  Within  range 
points  are  white. 

e.  ERI4-extracted  regions  mask. 

f.  Histogram  of  available  points  after 
deleting  extracted  regions. 

g.  Slice  range  mask. 

h.  ERM. 

i.  Histogram  of  new  APM. 

j.  Slice  range  mask. 

k.  ERI4. 

t.  Histogram  of  remaining  points, 
m.  Mask  of  remaining  points. 
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Figure  2.  Recursive  region  extraction  house  image 

a.  House  window  - median  filtered  average 
of  red,  green  and  blue  windows. 

b.  Edge  map. 

c. ,f.,i.,^.  Histograms  of  successive  APM's  with  slice 

ranges  indicated. 

d. ,g.,j.,n>.  Slice  range  masks. 

e. ,h.,k.,n.  Successive  ERM's. 

o.  Histogram  of  remaining  points. 

p.  Mask  of  remaining  points. 


Fig.  3a 


Fig.  3b 


Fig.  3c 
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Fig.  3d 


Fig.  3e 


Fig.  3f 


Fig.  3g 


Fig.  3h 


Figure 


3.  Effect  of  reordering  slice-ranges. 
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Histogram  as  in  Fig.  2i.  with  slice 
range  as  in  Fig.  2f . 

Slice  range  masks. 

Successive  ERM's. 

Resulting  histogram  with  slice  range 
Fig.  2i. 

Resulting  histogram. 

Mask  of  remaining  points. 
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